Papers with neural caption-based image retriever
Communication breakdown: On the low mutual intelligibility between human and neural captioning (2022.emnlp-main)
Copied to clipboard
| Challenge: | 0-shot performance of a neural caption-based image retriever is higher when fed captions from a human-produced caption generator . despite the fact that the caption generator does not take the set of distractor images into account, this performance is only marginally above chance level. |
| Approach: | They compare the 0-shot performance of a neural caption-based image retriever with captions from a human-produced captioner. |
| Outcome: | The proposed model performs better when given human-produced captions or neural captions . the best pre-trained model perform better when fed captions produced by an out-of-the-box model . |